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Abstract 

We present a tree-based construction of LDPC codes that have minimum pseudocodeword weight equal to 
or almost equal to the minimum distance, and perform well with iterative decoding. The construction involves 
enumerating a c?-regular tree for a fixed number of layers and employing a connection algorithm based on 
permutations or mutually orthogonal Latin squares to close the tree. Methods are presented for degrees d — p^ 
and d — p^ + \, for p a prime. One class corresponds to the well-known finite-geometry and finite generalized 
quadrangle LDPC codes; the other codes presented are new. We also present some bounds on pseudocodeword 
weight for p-ary LDPC codes. Treating these codes as p-ary LDPC codes rather than binary LDPC codes 
improves their rates, minimum distances, and pseudocodeword weights, thereby giving a new importance to 
the finite geometry LDPC codes where p > 2. 

Index Terms 

Low density parity check codes, pseudocodewords, iterative decoding, min-sum iterative decoding, p-ary 
pseudoweight. 



L Introduction 

Low Density Parity Check (LDPC) codes are widely acknowledged to be good codes due to their near 
Shannon-limit performance when decoded iteratively. However, many structure-based constructions of LDPC 
codes fail to achieve this level of performance, and are often outperformed by random constructions. (Excep- 
tions include the finite-geometry-based LDPC codes (FG-LDPC) of [12], which were later generalized in [19].) 
Moreover, there are discrepancies between iterative and maximum likelihood (ML) decoding performance of 
short to moderate blocklength LDPC codes. This behavior has recently been attributed to the presence of so- 
called pseudocodewords of the LDPC constraint graphs (or. Tanner graphs), which are valid solutions of the 
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iterative decoder which may or may not be optimal [11]. Analogous to the role of minimum Hamming distance, 
dmin, in ML-decoding, the minimum pseudocodeword weight', tt)min» has been shown to be a leading predictor 
of performance in iterative decoding [26]. Furthermore, the error floor performance of iterative decoding is 
dominated by minimum weight pseudocodewords. Although there exist pseudocodewords with weight larger 
than dmin that have adverse affects on decoding, it has been observed that pseudocodewords with weight 
^min < dmin are especially problematic [9]. 

Most methods for designing LDPC codes are based on random design techniques. However, the lack of 
structure implied by this randomness presents serious disadvantages in terms of storing and accessing a 
large parity check matrix, encoding data, and analyzing code performance. Therefore, by designing codes 
algebraically, some of these problems can be overcome. In the recent literature, several algebraic methods 
for constructing LDPC codes have been proposed [24][12][22][8]. These constructions are geared towards 
optimizing a specific parameter in the design of Taimer graphs - namely, either girth, expansion, diameter, 
or more recently, stopping sets. In this paper, we consider a more fundamental parameter for designing 
LDPC codes - namely, pseudocodewords of the corresponding Tanner graphs. While pseudocodewords are 
essentially stopping sets on the binary erasure chaimel (BEC) and have been well studied on the BEC in [5], 
[8], [23], [7], they have received little attention in the context of designing LDPC codes for other chaimels. The 
constructions presented in this paper are geared towards maximizing the minimum pseudocodeword weight 
of the corresponding LDPC Tanner graphs. 

The Type 1-A construction and certain cases of the Type 11 construction presented in this paper are designed 
so that the resulting codes have minimum pseudocodeword weight equal to or almost equal to the minimum 
distance of the code, and consequently, the problematic low-weight pseudocodewords are avoided. Some of 
the resulting codes have minimum distance which meets the lower tree bound originally presented in [20]. 
Since Wmm shares the same lower bound [9], [10], and is upper bounded by (imin, these constructions have 
^^min = c^min- It is worth noting that this property is also a characteristic of some of the FG -LDPC codes [19], 
and indeed, the projective-geometry-based codes of [12] arise as special cases of our Type II construction. It is 
worth noting, however, that the tree construction technique is simpler than that described in [12]. Furthermore, 
the Type I-B construction presented herein yields a family of codes with a wide range of rates and blocklengths 
that are comparable to those obtained from finite geometries. This new family of codes has Wmin = <^min > 
tree bound in most cases. 

Both min-sum and sum-product iterative decoding performance of the tree-based constructions are compa- 
rable to, if not, better than, that of random LDPC codes of similar rates and block lengths. We now present 
the tree bound on Wmm derived in [10]. 

Definition 1.1: The tree bound of a d left (variable node) regular bipartite LDPC constraint graph with 



'Note that the minimum pseudocodeword weight is specific to the LDPC graph representation of the LDPC code. 
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girth g is defined as 



nd,g) 



1 + d + d{d - 1) + d{d - If + ... + d{d - 1)'t^ , f odd , 
l + d + d(d-l) + ... + d(d-l)^ + 



(1) 



even 



Theorem 1.2: Let G be a bipartite LDPC constraint graph with smallest left (variable node) degree d and 
girth g. Then the minimum pseudocodeword weight Wmin (for the AWGN/BSC channels) is lower bounded by 



>T{d,g). 



This bound is also the tree bound on the minimum distance estabUshed by Tanner in [20]. And since the 
set of pseudocodewords includes all codewords, we have Wmin < <^min- 

We derive a pseudocodeword weight definition for the p-ary symmetric channel (PSC), and extend the tree 
lower bound on lUmin for the PSC. The tree-based code constructions are then analyzed as p-axy LDPC codes. 
Interpreting the tree-based codes as p-ary LDPC codes when the degree is d = p^ or d = p^ + 1 yields codes 
with rates > 0.5 and good distances. The interpretation is also meaningful for the FG LDPC codes of [12], 
since the projective geometry codes with d = p^ + l,p > 2 have rate ^ if treated as binary codes and rate 
> 0.5 if treated as p-ary LDPC codes. 

The paper is organized as follows. The following section introduces permutations and mutually orthogonal 
Latin squares. The Type 1 constructions are presented in Section 3 and properties of the resulting codes 
are discussed. Section 4 presents the Type 11 construction with two variations and the resulting codes are 
compared with codes arising from finite geometries and finite generalized quadrangles. In Section 5, we 
provide simulation results of the codes on the additive white Gaussian noise (AWGN) channel and on the 
p-ary symmetric channel. The paper is concluded in Section 6. 



II. Preliminaries 

A. Permutations 

A permutation on set of integers modulo m, {0, 1, . . . , m — 1} is a bijective map of the form 

TT : {0, 1, . . . , m - 1} ^ {0, 1, . . . , m - 1} 
A permutation is commonly denoted either as 

1 2 ... m - 1 
7r(0) 7r(l) 7r(2) . . . 7r(m - 1) 

or as (aiiai2...aisj(a2ia22---a2s2)---' where 0^2 = 7r(aa),Oi3 = 7r(ai2), • • • , Ois* = 7r(ai,5,_i), aa = 
7r(aisJ for all i. 
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As an example, suppose tt is a permutation on the set {0, 1, 2, 3} given by 7r(0) = 0, 7r(l) = 2, 7r(2) = 3, 

12 3 
2 3 1 

representation. 



7r(3) = 1. Then tt is denoted as 



in the former representation, and as (0)(123) in the latter 



B. Mutually orthogonal Latin squares (MOLS) 

Let F := GF{q) be a finite field of order q and let F* denote the corresponding multiplicative group -i.e., 
F* := F\{0}. For every a G F*, we define a q x q array having entries in F by the following linear map 

(f>a:¥ x¥ ^¥ 

{x,y) X + a ■ y 

where '+' and '•' are the corresponding field operations. The above set of maps define q — 1 mutually 
orthogonal Latin squares (MOLS) [pg. 182 - 199, [21]]. The map (f)a can be written as a matrix where 
the rows and columns of the matrix are indexed by the elements of F and the (x, y)*'* entry of the matrix is 
^a{x,y). By introducing another map defined in the following maimer 

(/)n : F X F -> F 



ix,y) 



X 



we obtain an additional array Mq which is orthogonal to the above family of g — 1 MOLS. However, note 
that Mo is not a Latin square. We use this set of q arrays in the subsequent tree-based constructions. 

As an example, let F = {0, 1, a, a^} be the finite field with four elements, where a represents the primitive 
element. Then, from the above set of maps we obtain the following four orthogonal squares 



Mo — 



Ml ~ 



OL 



1 a 

1 a Q,^ 
a 1 

a 1 



III. Tree-based Construction: Type I 

In the Type I construction, first a d-regular tree of alternating "variable" and "constraint" node layers is 
enumerated downwards from a root variable node (layer Lq) for £ layers. (The variable nodes and constraint 
nodes in this tree are merely two different types of vertices that give rise to a bipartition in the graph.) If ^ is 
odd (respectively, even), the final layer is composed of variable nodes (respectively, constraint nodes). 
Call this tree T. The tree T is then reflected across an imaginary horizontal axis to yield another tree, T', 
and the variable and constraint nodes are reversed. That is, if layer Lj in T is composed of variable nodes, 
then the reflection of Lj, call it L'-, is composed of constraint nodes in the reflected tree, T'. The union of 
these two trees, along with edges connecting the nodes in layers and L'^_i according to a connection 

February 1, 2008 DRAFT 



SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 



5 



algorithm that is described next, comprise the graph representing a Type I LDPC code. We now present two 
connection schemes that can be used in this Type I model, and discuss the resulting codes. 



A. Type I-A 

Figure 3 shows a 3-regular girth 10 Type I-A LDPC constraint graph. For d = 3, the Type I-A construction 
yields a d-regular LDPC constraint graph having 1 + d + d{d — 1) + . . . + d{d — 1)^^^ variable and constraint 
nodes, and girth g. The tree T has I layers. To connect the nodes in L^_i to L'^_^, first label the variable (resp., 
constraint) nodes in (resp., L'^_^) when I is odd (and vice versa when I is even), as fo, vi, • • • , f2<!-2_i, 
i;2«-2, . . . ,'y2-2*-2„i,t;2.2'-2, . . . ,f3-2*-2-i (rcsp., Co, ci, . . . , C3.2«-2_i). The nodes uq, . . . ,W2*-2_i form the 
0*'' class 5*0, the nodes ?;2'!-2, • • • ,V2.2^-^-i form the 1** class Si, and the nodes V2.2'-'^, ■ ■ ■ ,''>?-2'-2-i form 
the 2"^* class 52; classify the constraint nodes into S'q, 5[, and 5*2 in a similar manner. In addition, define 
four permutations 7r(-), t(-), r'(-), r"(-) of the set {0, 1, ... , 2^~^ — 1} and connect the nodes in Li_i to L^_]^ 
as follows: For j = 0, 1, . . . , 2^"^ - 1, 

1) The variable node Vj is connected to nodes c^(j) and c^(j)+2«-2- 

2) The variable node fj+2«-2 is connected to nodes c^(j)+2«-2 and c^'(j)+2-2«-2- 

3) The variable node Vj^2-2^-^ is connected to nodes C7r(j)+2.2*-2 and CT-„(^jy 

The permutations for the cases g = 10, 12 are given in Table I. For £ = 3, 4, 5, 6, these permutations 
yield girths = 6, 8, 10, 12, respectively, - i.e., g = 2£. It is clear that the girth of these graphs is upper 
bounded by 2£. What is interesting is that there exist permutations 7r,T, r',r" that achieve this upper bound 
when £ < 6. However, when extending this particular construction to £ = 7 layers, there are no permutations 
TT, T, r', t" that yield a girth g = 14 graph. (This was verified by an exhaustive computer search and computing 
the girths of the resulting graphs using MAGMA [13].) The above algorithm to connect the nodes in layers 
and L'^_i is rather restrictive, and we need to examine other connection algorithms that may possibly 
yield a girth 14 bipartite graph. However, the smallest known 3-regular graph with girth 14 has 384 vertices 
[I]. For £ = 7, the graph of the Type I-A construction has a total of 380 nodes (i.e., 190 variable nodes and 
190 constraint nodes), and there are permutations tt,t,t', and r", that only result in a girth 12 (bipartite) 
graph. 

When £ = 3,5, the minimum distance of the resulting code meets the tree bound, and hence, dmin = w^min- 
When £ = 4,6, the minimum distance dmin is strictly larger than the tree bound; in fact, dmin is more than 
the tree-bound by 2. However, Wmin = <^min for ^ = 4, 6 as well. 

Remark 3.1: The Type I-A LDPC codes have dmin = Wmin = T{d, 2£), for £ = 3,5, and dmin = ^i'min = 
2 + T{d, 2£), for £ = 4,Q. 



February 1, 2008 



DRAFT 



SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 



6 



Girth 


5 = 6 


ff = 8 


5 = 10 


ff = 12 


TT 


(0)(1) 


(0)(2)(1,3) 


(0)(2)(4)(6)(1,5)(3,7) 


(0)(4)(8)(12)(2,6)(10,14)(1,9)(3,15)(5,13)(7,11) 


r 


= TT 


= 77 


(0)(2)(4)(6)(1,7)(3,5) 


(0)(4)(8)(12)(2,6)(10, 14)(1, 13)(3, 11)(5,9)(7, 15) 


r 


= TT 


= TT 


= T 


(0,8)(4, 12)(2, 14)(6, 10)(1,5)(3)(7)(9, 13)( 1 1)( 15) 


ft 

T 


= TT 


(0,2)(1)(3) 


(0,4)(2,6)(1,3)(5,7) 


(0,2A6)(8,10,12,14)(1,15,5,11)(3,9,7,13) 



TABLE I 



Permutations for Type 1-A construction. 



B. Type I-B 

Figure 4 provides a specific example of a Type I-B LDPC constraint graph with d = 4 = 2^. For d = p^, 
a prime power, the Type I-B construction yields a d-regular LDPC constraint graph having 1 + d + d{d — 1) 
variable and constraint nodes, and girth at least 6. The tree T has 3 layers Lo,Li, and L2. The tree is 
reflected to yield another tree T' and the variable and constraint nodes in T' are interchanged. Let a be a 
primitive element in the field GF{p^). (Note that GF{p'^) is the set {0, 1, a, a^, . . . , a^^^^}.) The layer Li 
(resp., L']) contains p^ constraint nodes labeled (0)c, (l)c, (a)c, • • • , (a^°~^)c (resp., variable nodes labeled 

(0)', (1)', (a)', . . . , (q**'^^)')- The layer L2 (resp., Lg) is composed of sets {5'j}j=o,i,a,a2 „p'-2 of — 1 

variable (resp., constraint) nodes in each set. Note that we index the sets by an element of the field GF{p^). 
Each set Si corresponds to the children of one of the branches of the root node. (The in the labeling refers 
to nodes in the tree T' and the subscript 'c' refers to constraint nodes.) Let Si (resp., 5^') contain the variable 
nodes (i, 1), (i, a), . . . , (i, 0;*^°^^) (resp., constraint nodes (i, 1)'^, (i, a)^, . . . , (i, a*''^^)^). To use MOLS of 
order in the connection algorithm, an imaginary node, variable node (i,0) (resp., constraint node (i,0)^) 
is temporarily introduced into each set Si (resp, S'^. The connection algorithm proceeds as follows: 

1) For i = 0, 1, a, . . . , aP'~'^ and j = 0, 1, a, . . . , a^°~^, connect the variable node (i, j) in layer L2 to the 
constraint nodes 

(0,j + i-0);, + i {a^'-^j + i-aP'-y, 

in layer Lg. (Observe that in these connections, every variable node in the set Si is mapped to exactly 
one constraint node in each set S'l^, for k = 0,1, a, ... , oP'"'^, using the array Mj defined in Section 
2.B.) 

2) Delete all imaginary nodes {(i, 0), (i, 0)g}j=o,i,...,a''''-2 ^iid the edges incident on them. 

3) For z = 1, . . . , oP'~'^ , delete the edge connecting variable node (0, i) to constraint node (0, i)^. 
The resulting d-regular constraint graph represents the Type I-B LDPC code. 



The Type I-B algorithm yields LDPC codes having a wide range of rates and blocklengths that are 
comparable to, but different from, the two-dimensional LDPC codes from finite Euclidean geometries [12], 
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[19]. The Type I-B LDPC codes are p'' -regular with girth at least six, blocklength N = p^*' + 1, and distance 
rfmin > + 1. For degrees of the form d = 2*, the resulting binary Type I-B LDPC codes have very good 
rates, above 0.5, and perform well with iterative decoding. (See Table IV.) 

Theorem 3.2: The Type I-B LDPC constraint graphs have a girth of at least six. 

Proof: We need to show that there are no 4-cycles in the graph. By construction, it is clear that there 
are no 4-cycles that involve the nodes in layers Lq, L'q, Li, and L'l. This is because no two nodes, say, 
variable nodes (z, j) and {i,k) in a particular class Si are coimected to the same node (s,*)^ in some class 
S'g\ otherwise, it would mean that t = j - s = k + i- s. But this is only true for j = k. Therefore, suppose 
there is a 4-cycle in the graph, then let us assume that variable nodes and {s,t), for s ^ i, are each 
connected to constraint nodes (a, b)'^ and (e, /)^. By construction, this means that b = j + i- a = t + s- a and 
f = j + i ■ e = t + s ■ e. However then j — t = {s — i) ■ a = {s — a) ■ e, thereby implying that a = e. When 
a = e, we also have b = j + i- a = j + i- e = f. Thus, (a, 6)^ = (e, /)^. Therefore, there are no 4-cycles in 
the Type I-B LDPC graphs. 

■ 

Theorem 3.3: The Type I-B LDPC constraint graphs with degree d = and girth g >6 have 

2{p' - 1) > d^in > if^min > 6) = 1 + for p > 2, 

2{p') + 1 > dmin > Wn^in > T{p', 6) = 1 + p' for p = 2. 

Proof: When p is an odd prime, the assertion follows immediately. Consider the following active variable 

nodes to be part of a codeword: variable nodes (0, 1), (0, a), . . . , (0, Q!^°~^) in ^o, and all but the first variable 
node in the middle layer L[ of the reflected tree T': i.e., variable nodes (1)', (a)', (a^)', . . . , (a^^"^)' in L[. 
Clearly all the constraints in L2 are either connected to none or exactly two of these active variable nodes. The 
root node in T' is connected to — 1 (an even number) active variable nodes and the first constraint node in 
Li of T is also connected to — 1 active variable nodes. Hence, these 2{p^ — 1) active variable nodes form a 
codeword. This fact along with Theorems 1.2 and 3.2 prove that 2{p^ — l) > dmin > > T{p^,6) = 1+p'^. 

When p = 2, consider the following active variable nodes to be part of a codeword: the root node, variable 
nodes (0, 1), (0, a),... , (0, a^""^) in Sq, variable node (a\ a*) from S^', for i = 0,1,2, ... ,p^ — 2, and the 
first two variable nodes in the middle layer of T' (i.e., variable nodes (0)',(1)'). Since p = 2, p^ — 1 is odd. 
We need to show that all the constraints are satisfied for this choice of active variable nodes. Each constraint 
node in the layer Li of T has an even number of active variable node neighbors: (0)c has p^ active neighbors, 
and {i)c, for z = l,a,... ,0^"'^, has two, the root node and variable node It remains to check the 
constraint nodes in T'. 
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In order to examine the constraints in layer L'2 of T' , observe that the variable node (0, a-'), for j = 
1, 2, ... — 2, is connected to constraint nodes 

and the variable node (a*, a*), for i = 0, 1, 2, . . . , — 2, is connected to constraint nodes 

(0, a% (1, a' + aX, (a, a' + a'+%, {a\a'+^)'„ {aP'-\ a'+^'-y. 

Therefore, the constraint nodes (0, a^)^, for j = 1, 2, . . . — 2, in of L2 are connected to exactly one 
active variable node from layer L2, i.e., variable node (a-?, a^); the other active variable node neighbor is 
variable node (0)' in the middle layer of T'. Thus, all constraints in S'q are satisfied. 

The constraint nodes {l,a^y^, for j = 1, 2, . . . — 2, in S[ are each connected to exactly one active 
variable node from L2, i.e., variable node (0, a-') from S'q. This is because, all the remaining active variable 
nodes in L2, (a*, a*) connect to the imaginary node (1,0)'^ in S[ (since + a*)'^ = (1,0)'. when the 

characteristic of the field GF{p^) is p = 2). Thus, all constraint nodes in S[ have two active variable node 
neighbors, the other active neighbor being the variable node (1)' in the middle layer of T'. 

Now, let us consider the constraint nodes in S'^^, for A; = 1, 2, ... — 2. The active variable nodes (a*, a*), 
for i = 0, 1, 2, . . . — 2, are connected to the following constraint nodes 

(a^ 1 + a')',, (a^ a + {a\a^'-^ + a^'-'^^X, 

respectively, in class S'^^- Since a'' + a^^'' 7^ a* + a^^^* for r ^ t, the variable nodes (a*, a'), for i = 
0, 1, 2, . . . — 2, connect to distinct nodes in S'^k- Hence, each constraint node in S'^k has exactly two active 
variable node neighbors - one from So and the other from the set {(a*, a^)\ i = 0, 1, 2, . . . — 2}. 

Last, we note that the root (constraint) node in T' is connected to two active variable nodes, (0)' and (1)'. 
The total number of active variable nodes is 1 + {p^ — 1) + {p^ — 1) + 2 = 2p*' + 1. This proves that the set 
of 2p^ + 1 active variable nodes forms a codeword, thereby proving the desired bound. 

■ 

When p > 2, the upper bound 2{p^ — 1) on minimum distance dmin (and possibly also lUmin) was met 
among all the cases of the Type I-B construction we examined. We conjecture that in fact dmin = "^{p^ — 1) 
for the Type I-B LDPC codes of degree d = p^ when p > 2. Since u^min is lower bounded by 1 + p^, we 
have that u^min is close, if not equal, to dmin- 



C. p-ary LDPC codes 

Let be a parity check matrix representing a p-ary LDPC code C. The corresponding LDPC constraint 
graph G that represents is an incidence graph of the parity check matrix as in the binary case. However, 
each edge of G is now assigned a weight which is the value of the corresponding non-zero entry in H. (In 
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[4], [3], LDPC codes over GF{q) are considered for transmission over binary modulated cliannels, whereas 
in [18], LDPC codes over integer rings are considered for higher-order modulation signal sets.) 

For convenience, we consider the special case wherein each of these edge weights are equal to one. This 
is the case when the parity check matrix has only zeros and ones. Furthermore, whenever the LDPC graphs 
have edge weights of unity for all the edges, we refer to such a graph as a binary LDPC constraint graph 
representing a p-ary LDPC code C. 

We first show that if the LDPC graph corresponding to H is d-left (variable-node) regular, then the same 
tree bound of Theorem 1.2 holds. That is. 

Lemma 3.4: If G is a d-left regular bipartite LDPC constraint graph with girth g and represents a p-ary 
LDPC code C. Then, the minimum distance of the p-ary LDPC code C is lower bounded as 

dmin > T{d,g). 

Proof: The proof is essentially the same as in the binary case. Enumerate the graph as a tree starting at 
an arbitrary variable node. Furthermore, assume that a codeword in C contains the root node in its support. 
The root variable node (at layer Lq of the tree) coimects to d constraint nodes in the next layer (layer Li) of 
the tree. These constraint nodes are each coimected to some sets of variable nodes in layer L2, and so on. 
Since the graph has girth g, the nodes enumerated up to layer when § is odd (respectively, L^^ when 
I is even) are all distinct. Since the root node belongs to a codeword, say c, it assumes a non-zero value in 
c. Since the constraints must be satisfied at the nodes in layer L\, at least one node in Layer L2 for each 
constraint node in Li must assume a non-zero value in c. (This is under the assumption that an edge weight 
times a (non-zero) value, assigned to the corresponding variable node, is not zero in the code alphabet. Since 
we have chosen the edge weights to be unity, such a case will not arise here. But also more generally, such 
cases will not arise when the alphabet and the arithmetic operations are that of a finite field. However, when 
working over other structures, such as finite integer rings and more general groups, such cases could arise.) 

Under the above assumption, that there are at least d variable nodes (i.e., at least one for each node in 
layer Li) in layer L2 that are non-zero in c. Continuing this argument, it is easy to see that the number of 

non-zero components in c is at least 1 + d -|- d{d — 1) -I V d{d — 1)^ when | is odd, and 1 + d -|- d{d — 

1) + • • • + d{d — 1)^ + (d — 1)^ when | is even. Thus, the desired lower bound holds. 

■ 

We note here that in general this lower bound is not met and typically p-ary LDPC codes that have the 
above graph representation have minimum distances larger than the above lower bound. 

Recall from [11], [9] that a pseudocodeword of an LDPC constraint graph G is a valid codeword in some 
finite cover of G. To define a pseudocodeword for a p-ary LDPC code, we will restrict the discussion to 
LDPC constraint graphs that have edge weights of unity among all their edges - in other words, binary LDPC 
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constraint graphs that represent p-ary LDPC codes. A finite cover of a graph is defined in a natural way as 
in [11] wherein all edges in the finite cover also have an edge weight of unity. For the rest of this section, 
let G be a LDPC constraint graph of a p-ary LDPC code C of block length n, and let the weights on every 
edge of G be unity. We define a pseudocodeword F of G as an x p matrix of the form 

/o,o /o,i /o,2 • • • /o,p-i 

/l,0 /l,2 • • • 

^ — . . . . . ' 

/n-1,0 /n-1,1 /n-1,2 • • • /n-l,p-l 

where the pseudocodeword F forms a valid codeword c in a finite cover G of G and fij is the fraction of 
variable nodes in the i*^ variable cloud, for < i < — 1, of G that have the assignment (or, value) equal 
to j, ioT < j < p — 1, in c. 

A p-ary symmetric channel is shown in Figure 7. The input and the output of the channel are random 
variables belonging to a p-ary alphabet that can be denoted as {0, 1, 2, . . . ,p — 1}. An error occurs with 
probability e, which is parameterized by the channel, and in the case of an error, it is equally probable for an 
input symbol to be altered to any one of the remaining symbols. 



Following the definition of pseudoweight for the binary symmetric channel [6], we provide the following 
definition for the weight of a pseudocodeword on the p-ary symmetric channel. For a pseudocodeword F, let 
F' be the sub-matrix obtained by removing the first column in F. (Note that the first column in F contains the 
entries /o,o, /i,0) /2,0) • • • > /n-i,o-) Then the weight of a pseudocodeword F on the p-ary symmetric chaimel 
is defined as follows. 



Definition 3.5: Let e be a number such that the sum of the e largest components in the matrix F', say, 
fii,jiJi2,j2: fie,je' excBcds Ei^ii,i2,...,ie(l ~ Z^.o)- TfaeH the weight of F on the p-ary symmetric channel 
is defined as 

2e, if /ji,ji H I- /ie,je = Si^ii,i2,...,ie(-^ ~ -^^.o) ' 

2e - 1, if /i,j, + • ■ ■ + /i,j, > Ei^i,,j,,...,i^(l - /i,o)- 



wpsciF) 



Note that in the above definition, none of the j^'s, for k = 1,2, . . . ,e, are equal to zero, and all the i^'s, 
for A; = 1, 2, . . . , e, are distinct. That is, we choose at most one component in every row of F' when picking 
the e largest components. (See the appendix for an explanation on the above definition of "weight".) 

Observe that for a codeword, the above weight definition reduces to the Hamming weight. If F represents 
a codeword c, then exactly w = wtnic), the Hamming weight of c, rows in F' contain the entry 1 in some 
column, and the remaining entries in F' are zero. Furthermore, the matrix F has the entry in the first column 
of these w rows and has the entry 1 in the first column of the remaining rows. Therefore, from the weight 
definition of F, e = ^ and the weight of F is 2e = w. 
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We define the p-ary minimum pseudocodeword weight of G (or, minimum pseudoweight) as in the binary 
case, i.e., as the minimum weight of a pseudocodeword among all finite covers of G, and denote this as 
«^min(G) or tUmin whcn it is clcar that we are referring to the graph G. 

Lemma 3.6: Let G be a d-left regular bipartite graph with girth g that represents a p-ary LDPC code C. 
Then the minimum pseudocodeword weight Wmin on the p-ary symmetric channel is lower bounded as 



W^min > T{d, g) 



(l + d + d{d-\)+d{d-lf + ... + d{d-l)^), f odd , 
[1 + d + d{d - 1) + . . . + d{d - l)"^ + {d - 1)"^), f even . 



The proof of this result is moved to the appendix. We note that, in general, this bound is rather loose. 
(The inequality in (3), in the proof of Lemma 3.6, is typically not tight.) Moreover, we expect that p-ary 
LDPC codes to have larger minimum pseudocodeword weights than corresponding binary LDPC codes. By 
corresponding binary LDPC codes, we mean the codes obtained by interpreting the given LDPC constraint 
graph as one representing a binary LDPC code. 



D. p-ary Type I-B LDPC codes 

Theorem 3.7: For degree d = p^, the resulting Type I-B LDPC constraint graphs of girth g that represent 
p-ary LDPC codes have minimum distance and minimum pseudocodeword weight 

2p' + l> dmin > u;min > T{d, g). 



Proof: Consider as active variable nodes the root node, all the variable nodes in Sq, the variable nodes 
(a*, a*), for i = 0, 1, 2, . . . — 2, the first variable node (0)' in the middle layer of T' and one other variable 
node (y)', that we will ascertain later, in the middle layer of T' . 

Since the code is p-ary (and p > 2), assign the value 1 to the root variable node and to all the active 
variable nodes in 5*0. Assign the value p — 1 to the remaining active variable nodes in L2, (i.e., nodes (a*, a*), 
i = 0, 1, 2, . . . ,p* — 2). Assign the value 1 for the variable node (0)' in the middle layer of T' and assign the 
value p — 1 for the variable node (y)' in the middle layer of T'. We choose y in the following manner: 

The variable nodes (a*, a'), for z = 0, 1, 2, . . . — 2, are coimected to the following constraint nodes 

respectively, in class S^''. Either, the above set of constraint nodes are all distinct, or they are all equal to 
(a*^, 0)^. This is because, -\- a^'^'' = a* -I- a*+'^ if and only if either, r = t or 1 -|- a*^ = 0. So there is only 
one k e {0,1,2, ... ,p^ — 2}, for which 1 -|- a*^ = 0, and for that value of k, we set y = a*^. 
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From the proof of Theorem 3.3 and the above assignment, it is easily verified that each constraint node 
has value zero when the sum of the incoming active nodes is take modulo p. Thus, the set of + 1 active 
variable nodes forms a codeword, and therefore dmin < 2^^" + 1. Hence, from Lemmas 3.4 and 3.6, we have 

T{d,6) <Wn,in<drnin<2p' + 1. 

m 

It is also observed that if the codes resulting from the Type I-B construction are treated as p-ary codes 
rather than binary codes when the corresponding degree in the LDPC graph is d = p^, then the rates obtained 
are also > 0.5. (See Table IV). We also beUeve that the minimum pseudocodeword weights (on the p-ary 
symmetric chaimel) are much closer to the minimum distances for these p-ary LDPC codes. 



IV. Tree-based Construction: Type II 

In the Type n construction, first a d-regular tree T of alternating variable and constraint node layers is 
enumerated from a root variable node (layer Lq) for £ layers Lq,Li,... , as in Type I. The tree T is not 
reflected; rather, a single layer of (d — nodes is added to form layer L(. If £ is odd (resp., even), this 
layer is composed of constraint (resp., variable) nodes. The union of T and L^, along with edges coimecting 
the nodes in layers and L( according to a coimection algorithm that is described next, comprise the 
graph representing a Type n LDPC code. We present the coimection scheme that is used for this Type n 
model, and discuss the resulting codes. First, we state this rather simple observation without proof: 

The girth g of a Type II LDPC graph for i layers is at most 2£. 

The coimection algorithm for ^ = 3 and £ = A, wherein this upper bound on girth is in fact achieved, is as 
follows. 



A. 1 = 3 

Figure 5 provides an example of a Type II LDPC constraint graph for ^ = 3 layers, with degree d = 
4 = 3 + 1 and girth g = 6. For d = p^ + 1, where p is prime and s a positive integer, a d-regular tree 
is enumerated from a root (variable) node for £ = 3 layers Lo,Li,L2. Let a be a primitive element in the 
field GF{p^). The d constraint nodes in Li are labeled (a;)c, (0)c, (l)c, {oc)ci • • ■ > (a^°^^)c to represent the d 
branches stemming from the root node. Note that the first constraint node is denoted as {x)c and the remaining 
constraint nodes are indexed by the elements of the field GF{p^). The d{d — 1) variable nodes in the third 
layer L2 are labeled as follows: the variable nodes descending from constraint node {x)c form the class Sx 
and are labeled (x, 0), (x, 1), . . . , (x, dP'~'^), and the variable nodes descending from constraint node {i)c, for 
z = 0, 1, a, . . . , dP'""^, form the class Si and are labeled (z, 0), (z, 1), . . . , (z, a^°~^). 
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A final layer = L3 of (d — 1)^ ^ = p^^ constraint nodes is added. The p^^ constraint nodes in L3 
are labeled (0, 0)'„ (0, 1);,, . . . , (0, a^'-^, (1, 0);,, (1, . . . , (1, a^'-^)',, (aP'-^, 0)'„ ^'"2, 1)'^, . . . , 
{aP°^'^, aP"^"^)'^. (Note that the in the labeling refers to nodes in that are not in the tree T and the subscript 
'c' refers to constraint nodes.) 

1) By this labeling, the constraint nodes in L3 are grouped into d — 1 = classes of li — 1 = nodes in 
each class. Similarly, the variable nodes in L2 are grouped into d = p^ + 1 classes of d — 1 = nodes 
in each class. (That is, the i*'* class of constraint nodes is S'^ = {{i, 0)^, (^, l)c, ■ ■ ■ (^^~^)c}-) 

2) The variable nodes descending from constraint node (x)c are connected to the constraint nodes in L3 
as follows. Connect the variable node {x, i), for z = 0, 1, . . . , aP"~^, to the constraint nodes 

(i,0)^, ii,iy„ {i,aP'-X- 

3) The remaining variable nodes in layer L2 are connected to the nodes in L3 as follows: Connect the 
variable node (i, j), for i = 0, 1, a, ... , dP''~'^, j = 0, 1, . . . , dP'~'^, to the constraint nodes 

(0,j+z-0)'„ (l,j+z-l)'„ {a,j + i-a)'„ {a^' -\ j + i ■ a^' 

Observe that in these connections, each variable node is connected to exactly one constraint node 
within each class, using the array Mj defined in Section 2.B. 

In the example illustrated in Figure 5, the arrays used for constructing the Type 11 LDPC constraint graph 

2 

are ^ ^ ^ ^ ^ ^ 





000 




012 




021 


Mo = 


111 
222 


, Mi = 


120 
201 


, M2 = 


102 

210 



The ratio of minimum distance to blocklength of the resulting codes is at least ji^p^:^, and the girth is 
six. For degrees d of the form d = 2^ + 1, the tree bound of Theorem 1.2 on minimum distance and minimum 
pseudocodeword weight [20], [10] is met, i.e., dmin = itJmin = 2 + 2*, for the Type II, i = 3, LDPC codes. For 
p > 2, the resulting binary LDPC codes are repetition codes of the form [n, 1, n], i.e., dmin = n = 1 +p^ +p^^ 
and the rate is However, if we interpret the Type II ^ = 3 graphs, that have degree d = + 1, as the 
LDPC constraint graph of a p-ary LDPC code, then the rates of the resulting codes are very good and the 
minimum distances come close to (but are not equal to) the tree bound in Lemma 3.4. (See also [17].) In 
summary, we state the following results: 

. The rate of a p-ary Type H, ^ = 3 LDPC code is p2a+p.+i — [14]. 
• The rate of a binary Type n, ^ = 3 LDPC code is ^ for p > 2. 

Note that binary codes with p = 2 are a special case of p-ary LDPC codes. Moreover, the rate expression 
for p-ary LDPC codes is meaningful for a wide variety of p's and s's. The rate expression for binary codes 



^Note that in this example, GF(3) = {0, 1, 2}, '2' being the primitive element of the field. 
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with p > 2 can be seen by observing that any t rows of the corresponding parity-check matrix H is linearly 
independent if t < n. Since the parity-check matrix is equivalent to one obtainable from cyclic difference 
sets, this can be proven by showing that for any t < n, there exists a set of t consecutive positions in the first 
row of H that has an odd number of ones. 



B. Relation to finite geometry codes 

The codes that result from this £ = 3 construction correspond to the two-dimensional projective-geometry- 
based LDPC (PG LDPC) codes of [19]. We state the equivalence of the tree construction and the finite 
projective geometry based LDPC codes in the following. 

Theorem 4.1: The LDPC constraint graph obtained from the Type II i = 3 tree construction for degree 
d = p^ + 1 is equivalent to the incidence graph of the finite projective plane over the field GFij)^). 

It has been proved by Bose [2] that a finite projective plane (in other words, a two dimensional finite 
projective geometry) of order m exists if and only if a complete family of orthogonal m x m Latin squares 
exists. The proof of this result, as presented in [16], gives a constructive algorithm to design a finite projective 
plane of order m from a complete family of m x m mutually orthogonal Latin squares (MOLS). It is well 
known that a complete family of mutually orthogonal Latin squares exists when m = p^, a power of a prime, 
and we have described one such family in Section 2. Hence, the constructive algorithm in [16] generates 
the incidence graph of the projective plane PG{2,p^) from the set of — 1 MOLS of order p^. The only 
remaining step is to verify that the incidence matrix of points over lines of this projective plane is the same 
as the parity check matrix of variable nodes over constraint nodes of the tree-based LDPC constraint graph 
of the tree construction. This step is easy to verify as the constructive algorithm in [16] is analogous to the 
tree construction presented in this paper. 

The Type 11 £ = 3 graphs therefore correspond to the two-dimensional projective-geometry-based LDPC 
codes of [12]. With a little modification of the Type 11 construction, we can also obtain the two-dimensional 
Euclidean-geometry-based LDPC codes of [12], [19]. Since a two-dimensional Euclidean geometry may be 
obtained by deleting certain points and line(s) of a two-dimensional projective geometry, the graph of a two- 
dimensional EG-LDPC code [19] may be obtained by performing the following operations on the Type 11, 
£ = 3, graph: 

1) In the tree T, the root node along with its neighbors, i.e., the constraint nodes in layer Li, are deleted. 

2) Consequently, the edges from the constraint nodes (x)c, (0)c, (l)c, ■ ■ ■ , ("^ ~^)c to layer L2 are also 
deleted. 

3) At this stage, the remaining variable nodes have degree p^, and the remaining constraint nodes have 
degree p'' -I- 1. Now, a constraint node from layer L3 is chosen, say, constraint node (0, 0)^. This node 
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and its neighboring variable nodes and the edges incident on them are deleted. Doing so removes 
exactly one variable node from each class of L2, and the degrees of the remaining constraint nodes in 
L3 are lessened by one. Thus, the resulting graph is now p*-regular with a girth of six, has — 1 
constraint and variable nodes, and corresponds to the two-dimensional EucUdean-geometry-based LDPC 
code EG{2,p^) of [19]. 

Theorem 4.2: The Type II i = 3 LDPC constraint graphs have girth g = 6 and diameter 5 = 3. 

Proof: We need to show is that there are no 4-cycles in the graph. As in the proof of Theorem 3.2, 
by construction, there are no 4-cycles that involve the nodes in layers Lq and Li. This is because, first, no 
two variable nodes in the first class = {{x, 0), (x, 1), . . . , {x, aP""^)} are connected to the same constraint 
node. Next, if two variable nodes, say, and {i, k) in the z*'* class Si, for some z 7^ x, are coimected to a 
constraint node (s, t)'^, then it would mean that t = j + i- s = k + i- s. But this is only true for j = k. Hence, 
there is no 4-cycle of the form {i)c {i, j) {s, t)^ — > {i, k) — > {i). Therefore, suppose there is a 4-cycle in 
the graph, then let us consider two cases as follows. Case 1) Assume that variable nodes (i, j) and for 

s and z 7^ x 7^ s, are each coimected to constraint nodes (a, h)'^ and (e, f)'^. By construction, this means 
that h = j + i- a = t + s- a and f = j + i- e = t + s-e. This implies that j — t = {s — i) ■ a = [s — i) ■ e, 
thereby implying that a = e. Consequently, we also have b = j + i- a = j + i- e = f. Thus, (a, b)'^ = (e, /)^. 
Case 2) Assume that two variable nodes, one in Sx, say, (x, j), and the other in Si, (for i ^ x), say, (i, A;), 
are connected to constraint nodes (a, b)'^ and (e, /)^. Then this would mean that a = e = j. But since (i, k) 
connects to exactly one constraint node whose first index is j, this case is not possible. Thus, there are no 
4-cycles in the Type ll-i = 3 LDPC graphs. 

To show that the girth is exactly six, we see that the following nodes form a six-cycle in the graph: the 
root-node, the first two constraint nodes (x)c and (l)c in layer Li, variable nodes (x, 0) and (0, 0) in layer 
L2, and the constraint node (0, 0)^ in layer L3. 

To prove the diameter, we first observe that the root node is at distance of at most three from any other 
node. Similarly, it is also clear that the nodes in layer Li are at a distance of at most three from any other 
node. Therefore, it is only necessary to show that any two nodes in layer L2 are at most distance two apart and 
similarly show that any two nodes in L3 are at most distance two apart. Consider two nodes and {s,t) 

in L2. If s = i, then clearly, there is a path of length two via the parent node (i)c. If s 7^ i and s ^ x ^ i, 
then by the property of a complete family of orthogonal Latin squares there is a node (a, 5)'. in L3 such that 
b = j + i- a = t + s-a. This implies that and (s, t) are connected by a distance two path via (a, b)'^. 
We can similarly show that if ,s 7^ i and i = x, then the node (j, t + s ■ j)'^ in L3 connects to both (x, j) and 
{s,t). A similar argument shows that any two nodes in L3 are distance two apart. This completes the proof. 
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Theorem 4.3: For degrees d = 2* + 1, the resulting Type // £ = 3 LDPC constraint graphs have 

dmin = W^min = r(d,6) =2 + 2^ 

For degrees d = + 1, p > 2, when the resulting Type II £ = 3 LDPC constraint graphs represent p-ary 
linear codes, the corresponding minimum distance and minimum pseudocodeword weight satisfy 

T{p' + 1, 6) < W^in < C?min < 2p' . 

Proof: Let us first consider the case p = 2. We will show that the following set of active variable nodes 
in the Type U £ = 3 LDPC constraint graph form a minimum-weight codeword: the root (variable) node, 
variable nodes (a;,0), (0,0), {l,aP"-^), {a,aP'-^), {a'^,aP'-^), {a\aP"-^-'), (a^'-^ 1) in layer 

It is clear from this choice that there is exactly one active variable node from each class in layer L2. 
Therefore, all the constraint nodes at layer Li are satisfied. The constraint nodes in the first class S'q of 
L3 are (0, 0)^, (0, 1)^, . . . , (0, aP^'^c- The constraint node (0, 0)^ is connected to (x, 0) and (0, 0), and the 
constraint node (0, a*)^, for i = 0, 1, 2, . . . — 2, is connected to variable nodes {x, 0) and (a*, q;*'°~^~'). 
Thus, all constraint nodes in are satisfied. Let us consider the constraint nodes in class S'^i, for i G 
{0, 1, 2, . . . — 2}. The variable node (0, 0) connects to the constraint node (a*, 0)'^, in S'^i. The variable node 
(1, a^""^) connects to the constraint node (a*, a^""^ + a*)'^ in S'^,, and in general, for j = 0, 1, 2, . . . — 2, 
the variable node {a^ , aP°~'^~^) connects to the constraint node (a*, 0^°"^"-' +0*+-^)^ in S'^,. So enumerating 
all the constraint nodes in S'^,, with multiplicities, that are connected to an active variable node in L2, we 
obtain 

{a\Oy^, {a\aP'-^ + a%, {a\ aP° + {a\aP'-^'-'-^'^ + aP'-^)'^, {a\aP^-^^-''^ + aP'-^)'^, 

Simplifying the exponents and rewriting this list, we see that, when i is odd, the constraint nodes are 

(a\0)'„ {a\aP'~'^ + a%, {a\aP'-^ + a'+^y^, {a\ a'+^ + aP' {a\ a' + aP' -^Y^, {a\a'-^ + iy^, 
{a\ + a)[., {a\ + a(^-i)/2)'^,. . . , {a\ a + a'-^)'^, {a\ 1 + a^-^- 

(When i is even, the constraint nodes are (a*, 0)^, (a*, a^°~2+a*)[,, (a*, a^°~^+a*+-^)^, • . . , (a*, a'^P"~'^~^^^/'^+ 
aiP'-^+')/^y^, ...,{a\a'+'^ + aP^-^y^, (a\a'+aP^-^y^, {a\a'-^ + iy^, {a\a'-^+ay^, . . . , {a\a'+a'-^y^, 
{a\ a'-^ + a%,. . . , {a\ 1 + a*-^)c.) (Note that for p G GF{p^), /3 + /? = when the characteristic of the 
field GF{p') is two (i.e., p = 2).) 

Observe that each of the constraint nodes in the above hst appears exactly twice. Therefore, each constraint 
node in the list is connected to two active variable nodes in L2, and hence, all the constraints in S'^i are 
satisfied. So we have that the set of 1 + 2"^ + 1 active variable nodes forms a codeword. Furthermore, they must 
form a minimum- weight codeword since dmin > 2 + 2"^ = r(2* + 1,6) by the tree bound of Theorem 1.2. 
This also proves that dmin = if^min = T{d, 6) for d = 2* + 1. 
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Now let us consider the case p > 2. The resulting codes are treated as p-ary codes. Consider the following 
set of active variable nodes: the root node, all but one of the nodes {x,y), for an appropriately chosen y, in 
class Sx, and the nodes (q*, a*), for i = 0, 1, 2, . . . — 2. We have chosen 2p* active variable nodes in all. 

The variable nodes (1, 1), (a, a),. . . , (a^*""^, a^°~^) are connected to constraint nodes 

ia\0y„ (a^ 1 + a% (a^ a + a''+%, . . . , (a^ c^' + a'^+^Y,, (a^ a' + a'^+P'^^, 

respectively, in class S'^^,, of constraint nodes in layer L3. These nodes are either all distinct or all equal to 
{a^ , 0)'c since a* + a^^'^' = a* + if and only if either r = t or 1 + a'^ = 0. Since 1 + is zero for exactly 
one value of A: G {0, 1,2,... — 2}, we have that the variable nodes (a*, a*), for i = 0,1,2, ... — 2, 
are connected to distinct constraint nodes in all but one class S^fe. and that, in S^k*, they are all connected 
to the constraint node (a^*, 0)^. (Note that k* satisfies 1 + a*^* = 0.) We let y = a'^*. Therefore, the set of 
active variable nodes includes all nodes of the form (x, t), for t = 0,l,a,a^ , . . . , excluding node (x, y). 

Since the code is p-ary, assign the following values to the chosen set of active variable nodes: assign the value 
1 to the root variable node and to all the active variable nodes in class Sx, and assign the value p— 1 to the active 
variable nodes (a*, a*), for z = 0, 1, 2, . . . — 2. It is now easy to verify that all the constraints are satisfied. 
Thus, dmin < 2p*. From Theorem 4.2 and Lemmas 3.4 and 3.6, we have T{p^ + 1,6) < Wmm < <^min < 2p*. 

■ 

For degrees d = p^ + 1, p > 2, treating the Type II i = 3 LDPC constraint graphs as binary LDPC codes, 
yields [n, l,n] repetition codes, where n = p^^ + 1, dmin = n, and dimension is 1. However, when the 
Type II ^ = 3 LDPC constraint graphs, for degrees d = p'^ + 1, p > 2, are treated as p-ary LDPC codes, we 
believe that the distance dmin > + 3, and that this bound is in fact tight. We also suspect that the minimum 
pseudocodeword weights (on the p-ary symmetric channel) are much closer to the minimum distances for 
these p-ary LDPC codes. 



C. £ = 4 

Figure 6 provides an example of a Type II £ = 4 LDPC constraint graph with degree d = 2 + 1 = 3 and 
girth g = 8. For d = p'' + 1, p a prime and s a positive integer, a d regular tree T is enumerated from a root 
(variable) node for = 4 layers Lq, Li, L2, L^. 

1) The nodes in Lq,Li, and L2 labeled as in the ^ = 3 case. The constraint nodes in L3 are labeled as 
follows: The constraint nodes descending from variable node {x,j), for j = 0,1,, a,... ,dP''~'^, are 
labeled {x,j, 0)c, {x,j, l)c, . • • , {x,j, aP°~'^)c, the constraint nodes descending from variable node 

for i,j = 0,1,, a,... ,dF'~'^, are labeled {i,j,0)c, l)c, ■ ■ • , (i, j, a^°~^)c. 

2) A final layer = L4 of {d — lY~^ = p^* variable nodes is introduced. The p^* variable nodes 
in L4 are labeled as (0,0,0)', (0,0, 1)', (0,0, a^'-^y^ (0, 1,0)', (0, 1, 1)', . . . , (0, l,aP'-2)', 
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(aP'-2,0,0y, {aP'-^,0,iy, (aP'-2,0,aP'-2y, (a^'-^, a^'-^, 0)', {aP' , -\ 1)' , 
(a;P°~^, a^°~^, (Note that the '" in the labehng refers to nodes that are not in the tree T 

and the subscript 'c' refers to constraint nodes.) 

3) For < i < — I, < j < — 1, connect the constraint node {x, i,j)c to the variable nodes 

{i,j,oy,{i,j,iy,{i,j,ay,...,{i,j,aP'-''y. 

4) To connect the remaining constraint nodes in L3 to the variable nodes in L4, we first define a function 
/. For k,t = 0,1, a, ... , aP"'^ let 

/:FxFxFxF^F 

{i,j,k,t) ^ y, 

be an appropriately chosen function, that we will define later for some specific cases of the Type n 
£ = 4 construction. Then, for i, j,k = 0,1, a, ... , oP"~'^ , coimect the constraint node {%, j, k)c in L3 to 
the following variable nodes in L4 

{0,k+i-0,f{i,j,k,0)y, {l,k+i-l,f{i,j,k,l)y, {a,k+i-a,f{i,j,k,a)y, .., {aP'-\k+i-aP'-\f{i,j,k,aP'-^)y. 

(Observe that the second index corresponds to the linear map defined by the array Mj defined in Section 
2.B. Further, note that if f{i, j, k,t) = j + i-t, then the resulting graphs obtained from the above set of 
coimections have girth at least six. However, there are other functions f{i,j, k, t) for which the resulting 
graphs have girth exactly eight, which is the best possible when £ = 4in this construction. At this point, 
we do not have a closed form expression for the function / and we only provide details for specific 
cases below. (These cases were verified using the MAGMA software [13].) 



The Type II, i = 4, LDPC codes have girth eight, minimum distance dmin > 2(|)* + 1), and blocklength 
N = 1+p^ +p'^^ +p^'^. (We believe that the tree bound on the minimum distance is met for most of the Type 

II, £ = 4, codes, i.e. dmin = i(7min = 2(p* + 1).) For d = 3, the Type II, i = 4, LDPC constraint graph as 
shown in Figure 6 corresponds to the (2, 2)-Finite-Generalized-Quadrangles-based LDPC (FGQ LDPC) code 
of [25]; the function / used in constructing this example is defined by f{i,j,k,t) = j + {i + 1) ■ t, i.e., the 
map defined by the array Mj+i. The orthogonal arrays used for constructing this code are 

Mo=\" " 1 , Ml = [ " ' ' . 
We now state some results concerning the choice of the function /. 

1) The Type U £ = 4 construction results in incidence graphs of finite generaUzed quadrangles for 
appropriately chosen functions /. These graphs have girth 8 and diameter 4. 

2) For some specific cases, examples of the function f{i,j, k,t) that resulted in a girth 8 graph is given 
in Table n. (Note that for the second entry in the table, the function g : GF{4) GF{4) is defined 
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by the following maps: i-^ 1, 1 i-^ a, a i-^ o?, and o? i— > 0.) We have not been able to find a general 
relation or a closed form expression for / yet. 



V 


s 


elements 


degree 


f{i,j,k,t) 






of GFij,') 


rf = + 1 




2 


1 


{0,1} 


3 


j + {i + l)-t 


2 


2 


{0,l,Q,a2} 


5 


3 + gii) ■ t 


3 


1 


{0,1,2} 


4 


i ■ {k + 2 ■ i - t) + j 


3 


2 


{0, 1,Q, ..,q'^} 


10 


i ■ {k + a ■ i ■ t) + j 


5 


1 


{0,1,2,3,4} 


6 


i - {k + 3 ■ i-t) + j 


7 


1 


{0,1, 2,. .,6} 


8 


i - {k + 4- i-t) + j 



TABLE n 



The function / for the Type n£ = 4 construction. 



3) For the above set of functions, the resulting Type II ^ = 4 LDPC constraint graphs have minimum 
distance meeting the tree bound, when p = 2, i.e., dmin = "^iniii = 2(2'' + 1). We conjecture that, in 
general, for degrees d = 2* + 1, the Type II £ = 4 girth eight LDPC constraint graphs have dmin = 
ti;„ii„ = r(2^ + 1,8) = 2(2^ + 1). 

4) For degrees d = + 1, p > 2, we expect the corresponding jo-ary LDPC codes from this construction 
to have minimum distances dmin either equal or very close to the tree bound. Hence, we also expect 
the corresponding minimum pseudocodeword weight Wmin to be close to dmin- 

The above results were verified using MAGMA and computer simulations. 



D. Remarks 

It is well known in the literature that finite generalized polygons (or, A^-gons) of order exist [15]. A finite 
generalized A^-gon is a non-empty point-line geometry, and consists of a set V of points and a set C of lines 
such that the incidence graph of this geometry is a bipartite graph of diameter N and girth 2N. Moreover, 
when each point is incident on t+1 lines and each line contains t+1 points, the order of the A''-gon is said be to 
t. The Type 11 £ = 3 and i = 4 constructions yield finite generalized 3-gons and 4-gons, respectively, of order 
p*. These are essentially finite projective planes and finite generalized quadrangles. The Type II construction 
can be similarly extended to larger i. We believe that finding the right connections for connecting the nodes 
between the last layer in T and the final layer will yield incidence graphs of these other finite generalized 
polygons. For instance, for £ = 6 and £ = 8, the construction can yield finite generalized hexagons and finite 
generalized octagons, respectively. We conjecture that the incidence graphs of generalized AT-gons yield LDPC 
codes with minimum pseudocodeword weight u^min very close to the corresponding minimum distance dmin 
and particularly, for generalized AT-gons of order 2*, the LDPC codes have c/min = Wmin = T(2* -|- 1, 2N). 
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V. Simulation Results 

A. Performance with min-sum iterative decoding 

Figures 8, 9, 10, 11 show the bit-error-rate performance of Type I-A, Type I-B, Type II £ = 3 (girth six), 
and Type II i = A (girth eight) LDPC codes, respectively, over the binary input additive white Gaussian noise 
channel (BIAWGNC) with min-sum (not, sum-product!) iterative decoding, as a function of the channel signal 
to noise ratio (SNR) Eiy/N,,. The performance of regular or semi-regular randomly constructed LDPC codes 
of comparable rates and block lengths are also shown. (All of the random LDPC codes compared in this 
paper have a variable node degree of three and are constructed from the online LDPC software available at 

http : //www. cs . toronto . edu/~ radf ord/ldpc . software . html.) 

Figure 8 shows that the Type I-A LDPC codes perform substantially better than their random counterparts 
for all the codes shown. In these simulations, a maximum of 10000 iterations of min-sum decoding were 
allowed. 

Figure 9 reveals that the Type I-B LDPC codes perform better than comparable random LDPC codes at 
short block lengths; but as the block lengths increase, the random LDPC codes tend to perform better in the 
waterfall region. Eventually however, as the SNR increases, the Type I-B LDPC codes outperform the random 
ones and, unlike the random codes, they do not have a prominent error floor. For short block lengths (below 
4000), a maximum of 200 decoding iterations were allowed whereas for the longer block lengths, only up 
to 20 decoding iterations were allowed. The block length 16385, rate 0.951, Type I-B LDPC code performs 
significantly better than the corresponding random LDPC code of the same block length and rate. 

Figure 10 reveals that the performance of Type n £ = 3 (girth-six) LDPC codes is also significantly better 
than comparable random codes; these codes correspond to the two dimensional PG-LDPC codes of [19]. The 
Type II codes significantly outperform the corresponding random LDPC codes of comparable parameters at 
short block lengths. At longer block lengths, the random codes tend to perform better in the waterfall region 
due to their superior minimum distances. A maximum of 200 iterations were allowed for short block length 
codes (block lengths below 4000) whereas only 20 iterations were allowed for the block length 4161 code. 
Here again, the Type II codes do not reveal a prominent error as the corresponding random LDPC codes do, 
and at longer block lengths, they outperform the corresponding random LDPC codes in the high SNR regime. 

Figure 11 indicates the performance of Type II £ = 4 (girth-eight) LDPC codes; these codes perform 
comparably to random codes at short block lengths, but at large block lengths, the random codes perform 
better as they have larger relative minimum distances compared to the Type II £ = 4 (girth-eight) LDPC 
codes. In these simulations, a maximum of 200 decoding iterations were allowed for all the codes shown. 
The performance of the Type U £ = A LDPC codes reveal a similar trend as that of the Type Jl £ = 3 LDPC 
codes in Figure 10. 

As a general observation, min-sum iterative decoding of most of the tree-based LDPC codes (particularly. 
Type I-A, Type n, and some Type I-B) presented here did not typically reveal detected errors, i.e., errors 
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caused due to the decoder failing to converge to any valid codeword within the maximum specified number 
of iterations, which was set to 200 for short block length codes (and 20 for longer blocklength codes) in these 
simulations. Detected errors are caused primarily due to the presence of pseudocodewords, especially those 
of minimum weight. We think that the relatively low occurrences of detected errors with iterative decoding 
of these LDPC codes is primarily due to their good^ minimum pseudocodeword weight Wmin- 

B. Performance of Type I-B and Type II LDPC codes with sum-product iterative decoding 

Figures 12, 13, and 14 show the performance of the Type I-B, Type II £ = 3 and Type II £ = 4, respectively, 
LDPC codes with sum-product iterative decoding for the BIAWGNC. The performance is shown only for a 
few codes from each construction. The main observation from these performance curves is that the the tree- 
based LDPC codes perform relatively much better than random LDPC codes of comparable parameters when 
the decoding is sum-product instead of the min-sum algorithm. Although the Type I-B LDPC codes perform 
a little inferior to their random counterparts in the waterfall region when the block length is large, the gap 
between the performances of the random and the Type I-B LDPC codes is much smaller with sum-product 
decoding than with min-sum decoding. (Compare Figures 9 and 12.) Once again, a maximum of 200 decoding 
iterations were performed for block lengths below 4000 and 20 decoding iterations were performed for the 
block length 4097 LDPC code. 

Similarly, comparing Figures 13 and 10, we see that the Type n ^ = 3 LDPC codes perform relatively 
much better than their random counterparts with sum-product decoding than with min-sum decoding. They 
outperform the corresponding random LDPC codes at block lengths below 1000, whereas at the longer 
block lengths, the random codes perform better than the Type n codes in the waterfall region. Figure 14, in 
comparison with Figure II, shows a similar trend in performance of Type n £ = 4 (girth 8) LDPC codes 
with sum-product iterative decoding. 

Note that the simulation results for the min-sum and sum-product decoding correspond to the case when 
the LDPC codes resulting from constructions Type I and Type n were treated as binary LDPC codes for all 
choices of degree d = or d = + 1. We will now examine the performance when the codes are treated as 
p-ary codes if the corresponding degree in the LDPC constraint graph h d = p^ (for Type I-B) or d = p^ + 1 
(for Type II). (Note that this will affect only the performances of those codes for which p is not equal to 
two.) 

C. Performance of p-ary Type I-B and Type II LDPC codes over the p-ary symmetric channel 

We examine the performance of the p-ary LDPC codes obtained from the Type I-B and Type n constructions 
on the p-ary symmetric chaimel instead of the AWGN channel. The p-ary symmetric chaimel is shown in 



^i.e., relative to the minimum distance d, 
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Figure 7. An error occurs with probability e, the channel transition probability. Figures 15, 16, and 17 show 
the performance of Type I-B, Type II ^ = 3 and Type II ^ = 4, 3-ary LDPC codes, respectively, on the 
3-ary symmetric channel with sum-product iterative decoding. A maximum of 200 sum-product decoding 
iterations were performed. The parity check matrices resulting from the the Type I-B and Type II constructions 
are considered to be matrices over the field GF{3) and sum-product iterative decoding is implemented as 
outlined in [3]. The corresponding plots show the information symbol error rate as a function of the channel 
transition probability e. In Figure 15, the performance of 3-ary Type I-B LDPC codes obtained for degrees 
d = 3, c? = 3^, and d = 3^, is shown and compared with the performance of random 3-ary LDPC codes of 
comparable rates and block lengths. (To make a fair comparison, the random LDPC codes also have only 
zeros and ones as entries in their parity check matrices. It has been observed in [3] that choosing the non-zero 
entries in the parity check matrices of non-binary codes cleverly can yield some performance gain, but this 
avenue was not explored in these simulations.) In Figure 16, the performance of 3-ary Type U i = 3 (girth 
six) LDPC codes obtained for degrees d = 3 + 1, d = 3^ + 1, and d = 3^ -I- 1, is shown and compared with 
random 3-ary LDPC codes. Figure 17 shows the analogous performance of 3-ary Type U £ = A (girth eight) 
LDPC codes obtained for degrees d = 3 + 1 and d = 3^ -I- 1. In all these plots, it is seen that the tree-based 
constructions perform comparably or better than random LDPC codes of similar rates and block lengths. (In 
some cases, the performance of the tree-based constructions is significantly better than that of random LDPC 
codes (example. Figure 17).) 

The simulation results show that the tree-based constructions yield LDPC codes with a wide range of rates 
and block lengths that perform very well with iterative decoding. 



VI. Conclusions 

The Type I construction yields a family of LDPC codes that, to the best of our knowledge, do not correspond 
to any of the LDPC codes obtained from finite geometries or other geometrical objects. It would be interesting 
to extend the Type II construction to more layers as described at the end of Section 5, and to extend the 
Type lA construction by relaxing the girth condition. In addition, these codes may be amenable to efficient 
tree-based encoding procedures. A definition for the pseudocodeword weight of p-ary LDPC codes on the 
p-ary symmetric channel was also derived, and an extension of the tree bound in [9] was obtained. This 
led to a useful interpretation of the tree-based codes, including the projective geometry LDPC codes, for 
p > 2. The tree-based constructions presented in this paper yield a wide range of codes that perform well 
when decoded iteratively, largely due to the maximized minimum pseudocodeword weight. While the tree- 
based constructions are based on pseudocodewords that arise from the graph-cover's polytope of [II] and aim 
to maximize the miiumum pseudocodeword weight of pseudocodewords in this set, they do not consider all 
pseudocodewords arising on the min-sum iterative decoder's computation tree [26]. Nonetheless, having a large 
minimal pseudocodeword weight in this set necessarily brings the performance of min-sum iterative decoding 
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of the tree-based codes closer to the maximum-likelihood performance. However, it would be interesting to 
find other design criteria that account for pseudocodewords arising on the decoder's computation tree. 

Furthermore, since the tree-based constructions have the minimum pseudocodeword weight and the mini- 
mum distance close to the tree bound, the overall minimum distance of these codes is relatively small. While 
this is a first step in constructing LDPC codes having the minimum pseudocodeword weight Wram equal/almost 
equal to the minimum distance dmm, constructing codes with larger minimum distance, while still maintaining 
dmin = Wmin, remains a challenging problem. 



Appendix 

A. Pseudocodeword weight for p-ary LDPC codes on the p-ary symmetric channel 

Suppose the all-zero codeword is sent across a p-ary symmetric channel and the vector r = (ro, ri, . . . , r„_i) 
is received. Then errors occur in positions where 7^ 0. Let S = {i\ ri 7^ 0} and let S'^ = {i\ ri = 0}. The 
distance between r and a pseudocodeword F is defined as 

71-1 p-1 

a!(r,F) =^5;x(r^y^A:)Afe, (2) 
i=0 k=0 

where x(^) is an indicator function that is equal to 1 if the proposition P is true and is equal to otherwise. 
The distance between r and the all-zero codeword is 

n— 1 

d{r,0) = Y,xiri^O) 

1=0 

which is the Hamming weight of r and can be obtained from equation (2). 

The iterative decoder chooses in favor of F instead of the all-zero codeword when d{r,F) < d{r,0). 
That is, if 

E(i-Ao) + E(i-An)<Ei 

ieS" ies ies 

The condition for choosing F over the all-zero codeword reduces to 

{E(i-Ao)^EA'-.} 

Hence, we define the weight of a pseudocodeword F in the following maimer. 

Let e be a number such that the sum of the e largest components in the matrix F', say, fi^j^ , fi^j^ , . . . , fi^,j^, 
exceeds J2ijtii i^ i ~ /*,o)- Then the weight of F on the p-ary symmetric channel is defined as 



wpsc{F) 



2e, if + • • • + /i^j^ = - ko) 

2e - 1, if H h /j^j^ > Ei^ii,i2,...,i,(l - /j,o) 

Note that in the above definition, none of the j^'s, for A; = 1, 2, . . . , e, are equal to zero, and all the z^'s, for 
k = 1, 2, . . . , e, are distinct. That is, we choose at most one component in every row of F' when picking 
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the e largest components. The received vector r = (ro, ri, . . . , r„_i) that has the following components: 
fii = Jir'^ta = 32, - ■ ■ , = je, Ti = 0, for i ^ {ii, 12, . . . , ie], will cause the decoder to make an error and 
choose F over the all-zero codeword. 

B. Proof of Lemma 3.6 
Proof: 




Fig. 1. Single constraint code. Fig. 2. Local tree structure for a d-left regular graph. 

^^(l-/0,o)<EigLo(l-40), 

(1 - hfi) < E,yi(i - ho) d{d - i)(i - /o,o) < E,.L.(i - ko) 



Case: | odd. Consider a single constraint node with r variable node neighbors as shown in Figure 1 . Then, 
for i = 0, 1, . . . , r — 1 and = 0, 1, . . . ,p — 1, the following inequality holds: 



fi,k < 



o"j :E crj+k=0 mod p ^ ''^^ 



where the middle summation is over all possible assignments (t, G {0, 1, ... ,p — 1} to the variable nodes 
j ^ i such that k + J2j_^- aj = mod p, i.e., this is a valid assignment for the constraint node. The iimermost 
summation in the denominator is over all j i. 
However, for i = 0, 1, . . . , r — 1, the following (weaker) inequality also holds: 

(l-Ao)<i;(l-/i,o) (3) 

Now let us consider a d-left regular LDPC constraint graph representing a p-ary LDPC code. We will 
enumerate the LDPC constraint graph as a tree from an arbitrary root variable node, as shown in Figure 2. Let 
F be a pseudocodeword matrix for this graph. Without loss of generality, let us assume that the component 
(1 — /o,o) corresponding to the root node is the maximum among all (1 — /j o) over all i. 
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Applying the inequality in (3) at every constraint node in first constraint node layer of the tree, we obtain 

d(l-/o,o)< i;(l-/i,o), 

where Lq corresponds to variable nodes in first level of the tree. Subsequent apphcation of the inequality in 
(3) to the second layer of constraint nodes in the tree yields 

d(d-l)(l-/o,o)< E(l-/,-,o), 

Continuing this process until layer L^^, we obtain 

4 

1)^(1 -/o,o)< Yl 

Since the LDPC graph has girth g, the variable nodes up to level are all distinct. The above inequalities 

4 

yield: 

[l + d + d{d-l) + --- + did-l)'^]il- /o,o) < Yl (1 - Ao) < (1 - Ao) (4) 

je{o}uLoU...Lg-6 all i 

Let e the smallest number such that there are e maximal components /iiji, fi2,j2j hajs^ ■ ■ ■ i fi^,j^^ for 
ii,i2, . . . ,ie all distinct and j'l, J2, • • • ,ie £ {1) 2, ... ,p — 1}, in F' (the sub-matrix of F excluding the first 
column in F) such that 

fiujl + fi2,j2 H 1- fieje ^ ^ ~ ^^^^^ 

i<^{ii,i2,ia,...,ia} 

Then, since none of the j'^'s, = 1, 2, . . . , e, are zero, we clearly have 

(1 - /,„0) + (1 - fi2,0) + ■ ■ ■ + (1 - fi^,0) > + fi.,h + ■■■ + fieJe > E (1 - /^.O) 

i^{ii,i2,i3,--;iii} 

Hence we have that 

2((1 - fi,,o) + (1 - fi2,o) + • ■ ■ + (1 - fi^fi)) > E (1 - fifi) 

all i 

We can then lower bound this further using the inequality in (4) as 

2((1 - /,,,o) + (1 - fi2,o) + • ■ ■ + (1 - /i„o)) > [1 + d + d(d - 1) + ■ ■ ■ + d(d - 1)"^^](1 - /o,o) 
Since we assumed that (1 — /o,o) is the maximum among (1 — /j o) over all i, we have 
2e(l - /o,o) > 2((1 - fi,,o) + (1 - /i^o) + • • • + (1 - /ie,o)) > [1 + d + d(d - 1) + • • • + d(d - 1) ^] (1 - /o,o) 
This yields the desired bound 

wpsc{F) = 2e > 1 + d + d(d - 1) + • ■ ■ + d(d - 1)^ 
Since the pseudocodeword F was arbitrary, we also have Wmin 

> I + d + d{d - I) + ■ ■ ■ + d{d - 1) — . The 

case I even is treated similarly. 

■ 
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C. Table of code parameters 

The code parameters resulting from the tree-based constructions are summarized in Tables III, IV, V, and 
VI. Note that * indicates an upper bound instead of the exact minimum distance (or minimum pseudocodeword 
weight) since it was computationally hard to find the distance (or pseudoweight) for those cases. Similarly, for 
cases where it was computationally hard to get any reasonable bound the minimum pseudocodeword weight, 
the corresponding entry in the table is left empty. The lower bound on u;min seen in the tables corresponds to 
the tree bound (Theorem 1.2). It is observed that when the codes resulting from the construction are treated 
as p-ary codes rather than binary codes when the corresponding degree in the LDPC graph is d = (for 
Type I-B) or d = + 1 (for Type 11), the resulting rates obtained are much superior; we also beUeve that 
the minimum pseudocodeword weights (on the p-ary symmetric chaimel) are much closer to the minimum 
distances for these p-ary LDPC codes. 
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5 


7 


0.2692 


8 


8* 


6 


6 


5 


binary 










(7) 


(0.2692) 


(10) 


() 








5-ary 


7 


1 


50 


7 


11 


0.2200 


12 


12* 


8 


6 


5 


binary 










(16) 


(0.3200) 


(15) 


() 








7-ary 


2 


3 


65 


8 


31 


0.4769 


10 


10* 


9 


6 


5 


binary 


3 


2 


82 


9 


15 


0.1829 


16 


> 10 


10 


6 


5 


binary 










(38) 


(0.4634) 


(15) 


() 








3-ary 


11 


1 


122 


11 


19 


0.1557 


20* 


> 12 


12 


6 


5 


binary 










(46) 


(0.3770) 


(30*) 


() 








11-ary 


2 


4 


257 


16 


161 


0.6264 


20* 


> 17 


17 


6 


5 


binary 


5 


2 


626 


25 


47 


0.075 


48* 


> 26 


26 


6 


5 


binary 










(377) 


(0.6022) 


(90*) 


() 








5-ary 


3 


3 


730 


27 


51 


0.0698 


52* 


> 28 


28 


6 


5 


binary 










(488) 


(0.6684) 


(60*) 


() 








3-ary 


2 


5 


1025 


32 


751 


0.7326 


40* 


> 33 


33 


6 


5 


binary 


7 


2 


2404 


49 


95 


0.0395 


96* 


> 50 


50 


6 


5 


binary 










(1572) 


(0.6536) 


(216*) 


() 








7-ary 



TABLE IV 

Summary of Type I-B code parameters. 
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p 


s 


block length 


degree 


dimension 


rate 


drain 


^min 


tree 


girth 


diameter 


code 








d = + 1 










lower-bound 


9 


5 


alphabet 


2 


1 


7 


3 


3 


0.4285 


4 


4 


4 


6 


3 


binary 


3 


1 


13 


4 


1 


0.0769 


13 


6* 


5 


6 


3 


binary 










(6) 


(0.4615) 


(6) 


( ) 








3-ary 


2 


2 


21 


5 


11 


0.5238 


6 


6 


6 


6 


3 


binary 


5 


1 


31 


6 


1 


0.0322 


31 


10* 


7 


6 


3 


binary 










(15) 


(0.4838) 


(10*) 


() 








5-ary 


7 


1 


57 


8 


1 


0.017 


57 


16* 


9 


6 


3 


binary 










(28) 


(0.4912) 


(14*) 


( ) 








7-ary 


2 


3 


73 


9 


45 


0.6164 


10 


10 


10 


6 


3 


binary 


3 


2 


91 


10 


1 


0.0109 


91 


> 11 


11 


6 


3 


binary 










(54) 


(0.5934) 


(15*) 


() 








3-ary 


2 


4 


273 


17 


191 


0.6996 


18 


18 


18 


6 


3 


binary 


5 


2 


651 


26 


1 


0.0015 


651 


> 27 


27 


6 


3 


binary 










(425) 


(0.6528) 


(56*) 


() 








5-ary 



TABLE V 

Summary of Type 11, £ = 3 code parameters. 



p 


s 


block length 


degree 


dimension 


rate 




Wmin 


tree 


girth 


diameter 


code 








d=p'+l 










lower-bound 


9 


<5 


alphabet 


2 


1 


15 


3 


5 


0.3333 


6 


6 


6 


8 


4 


binary 


3 


1 


40 


4 


15 


0.3750 


10 


> 8 


8 


8 


4 


binary 










(15) 


(0.3750) 


(10*) 


( ) 








3-ary 


2 


2 


85 


5 


35 


0.4117 


10 


10 


10 


8 


4 


binary 


5 


1 


156 


6 


65 


0.4167 


20* 


> 12 


12 


8 


4 


binary 










(65) 


(0.4167) 


(26*) 


( ) 








5-ary 


7 


1 


400 


8 


175 


0.4375 


66* 


> 16 


16 


8 


4 


binary 










(175) 


(0.4375) 


(il9) 


( ) 








7-ary 


2 


3 


585 


9 


287 


0.4905 


18 


18 


18 


8 


4 


binary 


3 


2 


820 


10 


369 


0.4500 


112* 


> 20 


20 


8 


4 


binary 










(395) 


(0.4817) 


(96*) 


() 








3-ary 



TABLE VI 

Summary of Type ll,£ = 4 code parameters. 
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Fig. 4. Type I-B LDPC constraint graph having degree d — 4 and girth g — 6. 
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Fig. 5. Type 11 LDPC constraint graph having degree d — 4 and girth g — 6. 



February 1, 2008 



SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 



31 




(0,0,0)' (0,0,1)' (0,1,0)' (0,1,1)' (1,0,0)' (1,0,1)' (1,1,0)' (1,1,1)' 



Fig. 6. Type II LDPC constraint graph having degree d = 3 and girth 5 = 8. (Shaded nodes highlight a minimum weight codeword.) 
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Fig. 7. A p-ary symmetric channel. 
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Performance of Type l-A versus Random LDPCs 




Type I, d=3,g=10,N=46,rate=0.217 

Random, N=46,rate=0.217 
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Random, N=190,rate=0.132 
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Fig. 8. Performance of Type I-A versus Random LDPC codes on the BIAWGNC with min-sum iterative decoding. 



Performance of Type l-B versus Random LDPCs 
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Fig. 9. Performance of Type I-B versus Random LDPC codes on the BIAWGNC with min-sum iterative decoding. 



February 1, 2008 



DRAFT 



SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 



33 



10" 



10 



10" 



Performance of Type II versus Random LDPCs (Girth = 6) 
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Fig. 10. Performance of Type II £ = 3 versus Random LDPC codes on the BIAWGNC with min-sum iterative decoding. 



Performance of Type II versus Random LDPCs (Girth - 8) 
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Fig. 11. Performance of Type II £ — 4 versus Random LDPC codes on the BIAWGNC with min-sum iterative decoding. 
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Performance of Type l-B versus Random LDPCs with sum-product iterative decoding 
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Fig. 12. Performance of Type I-B versus Random LDPC codes on the BIAWGNC with sum-product iterative decoding. 



Performance of Type II (L=3) versus Random LDPCs withi sum-product iterative decoding 
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Fig. 13. Performance of Type II ^ = 3 versus Random LDPC codes on the BIAWGNC with sum-product iterative decoding. 
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Performance of Type II (L=4) versus Random LDPCs with sum-product iterative decoding 
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Fig. 14. Performance of Type II £ — 4 versus Random LDPC codes on the BIAWGNC with sum-product iterative decoding. 



^ Performance of Type l-B vs. Random 3-ary LDPCs over the 3-ary symm. channel with sum-product decoding 
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Fig. 15. Performance of Type I-B versus Random 3-ary LDPC codes on the 3-ary symmetric channel with sum-product iterative 
decoding. 
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Performance of Type II (L=3) vs. Random 3-ary LDPCs on the 3-ary symm. channel with sum-product decoding 
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Fig. 16. Performance of Type II ^ = 3 versus Random 3-ary LDPC codes on the 3-ary symmetric ciiannel with sum-product iterative 
decoding. 



Performance of Type II {L=4) vs. Random 3-ary LDPCs on the 3-ary symm. channel with sum-product decoding 
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Fig. 17. Performance of Type II £ — 4 versus Random 3-ary LDPC codes on the 3-ary symmetric channel with sum-product iterative 
decoding. 
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Performance of Type II (L=3) versus Random LDPCs with sum-product iterative decc 
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Performance of Type II versus Random LDPCs (Girth = 6) 




Performance of Type II (L=4) versus Random LDPCs with min-sum iterative decodi 
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